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Sir: 



I, Anthony Mai, hereby declare as follows: 



1 . I am a named inventor of the above-noted United States Patent Application 
10/700,798, filed in the United States Patent and Trademark Office on November 3, 2003, with a 
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claim of priority under 35 U.S.C. 1 19(e) to Provisional Application 60/513,098, filed October 
20, 2003. 

2. I hereby declare I conceived and reduced to practice the invention defined by claim 
24 ("the invention") of the above-noted application prior to April 9, 2002, the United States 
filing date of United States Patent 7,174,382 issued to Ramanathan et al. ("Ramanathan"), as 
demonstrated in the exhibits attached to this Declaration. My earlier conception and reduction to 
practice of my claimed invention is evidenced by the following statements: 

3. Prior to April 9, 2002, 1 conceived of the invention of the present ^plication as 
evidenced by Exhibit A, titled "Multi-Channel Multi-Party Audio Streaming Protocol" 
("Protocol"), which was attached to an e-mail that I sent to G. Van Datta prior to April 9, 2002. 
Language in the e-mail portion of Exhibit A has been redacted to preserve attorney-client 
privileged information. Specific nomenclature in the Protocol has been redacted to preserve 
confidential information. 

4. The Protocol discloses the elements recited in claim 24. In particular, the Protocol 
describes the method of joining (adding) a peer system to a peer-to-peer (P2P) system and a 
method of establishing a P2P network. 

5. My invention was reduced to practice in a computer implementation as evidenced by 
the attached Exhibits B and C, which perform the fimctions recited by the elements recited in 
claim 24. These exhibits are source code that is proprietary to the assignee of the present 
invention; and such source code has been redacted to preserve the confidentiality of such source 
code. 

6. Exhibit B is computer source code created prior to April 9, 2002. Exhibit B 
constructs and sends out communications packages, as well as receives and processes incoming 
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communication packages, pertaining to the forming and maintenance of the relay grid. Exhibit B 
describes the data packages that the relay grid tries to relay. Portions of Exhibit B have been 
redacted to preserve confidential information. 

7. Exhibit C is computer source code created prior to April 9, 2002. Exhibit C 
manages tiie features in Exhibit B as well as manages the high level application requests. Exhibit 
C generates and processes the message packages that are used to implement the invention. 
Exhibit C also accepts incoming and outgoing audio data streams and processes the data streams 
in proper data packages Exhibit C utilizes and manages Exhibit B to allow each client to interact 
with each other using pre-defined message packages in order to connect to each other and form 
the relay grid described in the invention. Function calls firom Exhibit C are reproduced in 
Exhibits C1-C8 and are explained in more detail herein as necessary. Portions of Exhibits C and 
C1-C8 have been redacted to preserve confidential information. 

8. The function call on page 1 0 of Exhibit C and reproduced as Exhibit CI causes the 
code to start the process to construct a relay grid, which implements the element "adding a peer 
system to a peer-to-peer relay network," recited in claim 24. 

9. The fiinction call on page 1 1 of Exhibit C and reproduced as Exhibit C2 causes the 
code to process any incoming network package and decide further processing depending on the 
package, which implements "opening a connection between a server and a joining peer system," 
recited in claim 24. 

10.. The function call on page 24 of Exhibit C and reproduced as Exhibit C3; the 
function call on page 25 of Exhibit C and reproduced as Exhibit C4; the function call on page 26 

of Exhibit C and reproduced as Exhibit C5; and the function call on page 27 of Exhibit C and 
reproduced as Exhibit C6; cause the code to allow top application layer code to obtain 
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information about existing channels (relay grid) and clients who have joined in each channel, 
which implements "providing grid information to said joining peer system indicating one or 
more established peer-to-peer relay networks," recited in claim 24. 

1 1 . The function call on page 22 of Exhibit C and reproduced as Exhibit C7 causes the 
code to cause the local client to join a relay grid, which implements "receiving a grid selection 
from said joining peer system indicating a selected peer-to-peer relay network, wherein said 
selected peer-to-peer relay network has one or more member peer systems," recited in claim 24. 

12. The ftmction call on page 27 of Exhibit C and reproduced as Exhibit C8 causes the 
code to provide bookkeeping of the network address of individual member peer systems to the 
underlying implementation of the peer relay system, which implements "providing network 
addresses of each of said one or more member peer systems to said joinmg peer system," recited 
in claim 24. 

13. The function call on page 22 of Exhibit C and reproduced as Exhibit C7 causes the 
code to enable a local client to join a relay grid, which implements "receiving a coimection 
update from said joining peer system indicating to which member peer systems said joining peer 
system is connected," recited in claim 24. 

14. The function call on page 22 of Exhibit C and reproduced as Exhibit C7 causes the 
code to start a sequence of actions and message exchanges, which implements "wherein each 
member peer system is connected to a number of other member peer systems that is less than or 
equal to a coimection limit and each member peer system stores a set of one or more relay rules 
for relaying data to the other member peer systems connected to that member peer system," 
recited in claim 24. 
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15. As evidenced by attached Exhibits A through C, every element of my claimed 
invention was reduced to practice prior to April 9, 2002. 

I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 

punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may jeopardize the validity of the application or any 



Si^iahire of D^arant 
Anthony Mai 





Date 



Print or Typed of Declarant 



Page 5 of 5 



00S18648.OOC 



EXHIBIT A 

I 



Attachments : 




Anthony Mai 

Sony Computer Entertainment Amerii 
http : //www. scea. com 



Anthony Mai /SDPD/ SCEA 



Glen Van 
Datta/SDPD/SCEA 



The docToment 



Here is the doc file attackment. 



Anthony Mai 

Sony Computer Entertainment America 
http://www.scea.com (See attached file:| 



Multi-Channel Multi-Party Audio Streaming Protocol 



Introduction 

Audio streaming in the online game scenery is different from conventional VoIP 
application in a number of ways. First, conventional VoIP system has only one data 
source. It may have one data target, like in the case of internet telephone, or it may have 
one server and multiple data targets, like in the case of internet radio or other broadcast 
steaming. 

In the online game scenery, there could be multiple data sources (each player in a 
game may speak), and there could also be multiple data targets (each player in a game 
may also listen.) And there may not even be a central server to receive and re-distribute 
all the audio data. 

Due to network bandwidth limitation, a multi-channel Multi-party audio 
streaming protocol must be designed to allow multiple players to talk with each other 
over the network. 



Assumption of the protocol: 

The following assumptions will be made: 




mdntains a list of all the available audio channels, or 

audio roonBBBBI ^B au thorization of each player in each room to speak. 
Each individual player IHIkeeps a copy of the audio room list. 

3. The network grid. Each H will be connected to no more thanB>ther 

■ directly. Any data initially received by a from one of theB 
it connects to will be forwarded to the two other HH. Repeated data 
is not forwa rded. By this mechanism, data from any one]|m can eventually 
spread to all IH in the grid. 



The network grid ^^^^ 

The grid limits each [^^H network bandwidth requirement (sinc e it on ly needs 
to communicate withHotherj^Hj) while allowing dat^om any singje to 
quickly spread to every other jBJin the grid, using [^sockets. 

There will be a network grid for the channel 0, or room #0. All are 
connected to this grid. This will be used for none-audio control messages. 

There will be ^Hjj^^^^^^lHfo^each audio room. Each can 
optionally join a specific audio room. Butea^J||||||||||| can join no more than one audio 
room at a time. 
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BachHHis connected to 3 other^H, forming a grid 




Wi thin each audio room grid, J 

Any IBIi wishing to speak should wait until the si 
multiple players try to s 



Establishment of the audio room network grid 

Any Bl can create an audio room and this event is broadcast to every one in the 
game, through the channel 0 grid. The that created the audio room becomes the 
first node of the network grid. It will notice that it has three arms of connection, none 
occupied yet. 

Any Hll wishing join an audio room broadcast a m essage through the 
channel 0 grid. Every within the grid then sends the new ^ welcome 

message, specifying whether they have a free arm of connection available or not. 



The new HH S'^st takes offers of connection from existingHBH who has a free 
arm of connection. And then request connection with the v ery first ||^|who greeted it 
TIIIII^^BBUpo n such request, the existing 
|one of its connections and connects with the new 

nnection will 1hen||^^Hpbe availability of 
who also have free connection arm will respond to 
establishes a connection. 




Establishment of the channel 0 grid 

Channel 0 grid is the net work grid that eve 
important that when each H joins the game,H 



1. First H 

When the first H creates a new g ame se ssion, there are no other 
lllflllllthree grid connections of the first HI available. 





Fourth WW joins the game. 



The new joining protocol: 



.1 .The game ser ver sen ds the new info to all existing ■H wi^n a game, 
2.Each existing f///^ sends a welcome UDP message to the new ^f///^, indicating 

whether it has any spa re connection arm available. 
S.Thenewl 




I directly. 

\ that receives the connection request message llll^ o 
led. 



the! 

4. The l 

^^ e back. And the connection is establishec 

5. If the new f/j/j^ still has 2 or more connection arms un iised, it further sends a 
connection request message to the first existing IBi ^ho sent a welcome 
message with no available connection a rm. 

6. Upo^onnection requests from the new jH, an existing ||||||||H would 
UmP^reak one of the connec tion ar ms, and then sends a 
accepted message back to the new ll^l. 




So it is 



Maintaining the grid 

HH could drop outof^ 
important that the grid can^^^^ 

1 . Each pair of conn ected other periodically. 
^^HHHjjjjjljjjpndicates that a conne ction is still alive. 

2. IfUmfA. is infoime^fdisconnectioi^ orH^HIHH 
not been received |^^^B|[|||[||^||||pheHBm^k^ that connection 
arm as free, and send out a connection arm available message, on channel 0. 

3. When mil B receives a connection arm available message, and it has a free 
conne ction a rm, it responds by sending a connection r equest mes sage. 

4. When H^^^ecdves a connection request message,^HHi^i™^<^tio^ 
acceptedBHHIH-^^^ connected. 

Dropping out of the grid 

If a Hli intend to quit the game, it should post a message to all |H| it 
connects to indicatin^iaUH^uittir^ 

Wh^i^^^^^^llllllllllllllll^^^^lll^^ int erval from a connected 

■H, I^^^^HHHII^^ connection no longer exist, andH^H^^^HHH 

through th^dsting arms of connection that it has a fr ee arm of connection avail able. 
Any other who also has a free arm of connection HHI|||H|H|||||^HI||the two 

can connect. 



Transferring data within the grid 



The network grid is established to allow all HH within the grid to share 
informatioi^vitluninimani^ 

so when a m recei ves th e packaeeJ^iow^hetheHyia^lrea^ 
package or the H||||H^i^'^|HIHIHliH^llll^^ 

package to the othe£two T[B| it connects to, except for the one that it just rec eived the 

the pa ckage from further circul ation within the grid. 

Illlllll^^ repeated packa g es received, and chances of lost 

package will be extremely low, since Q^^^^Mjs^^^K/j^^K/////f////lll^ and 
the packaged could be forwarded to the BBflB^^^BBBiniisw^flienetwork 



Transferring audio data within the grid 
Each package of audio data 




I deci de whe ther it can speak or not according to the following rules: 
1 . If noHB'ackage was received within certain time period (like 1 -2 
seconds), it can start to speak, 
one or ■■■^^^^^^^^^■■^^^■ithat means the 

previous spe^er^Hl^^^mpo&e^^^ai^tart to speak. 

3 . If after a starts to speak, it receives a ^^H|||||^|[from a 

differ ent a collision has occurred. Under such circumstance the 
HI should immediately stop speaking, and wait for the next 
opportuni ty to s peak. 
When the BB | can start | 

^_^_|that the human player can start to speak. The 

player may or may not speak. I f the player speaks, it wi ll be 

land the | 
ito the network grid. 

5. When a I _ 

silence p ackage will be send out, allowing other to speak, while 
the locsdBfll will wait for next opportunity t o speak. 

6. If a [Hl^edcs for jjjjjjjjjj^^HHjHjj^Hli '^'^^ ^ forcefully 
stopped, allowing iilln i |B| i In start speaking. 
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else 
{ 
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Exhibit C5 



Description: Enumerate all existing players in a specific channel. Entuneration 
continues until all players have run through, or the enumeration 
function returns zero. 




Exhibit C6 




Pagel 




Pagel 



Exhibit C7 



Page 2 



Exhibit C8 




Pagel 



